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WO 00/22534 PCT/US99/23158 

Method and Apparatus for Testing Web Transactions 



BACKGROUND OF THE INVENTION 



This invention relates generally to wide area networks, and more particularly to the 
testing of web sites hosted by web servers coupled to a TCP/IP protocol network. 

The Internet has, of late, become ubiquitous. The Internet is a robust, Wide Area 
Network (WAN) of networks which permits communication among computers, networks, and 
other digital devices which adhere to a standard "TCP/IP" protocol. One of the most popular 
ways of communicating over the intersite is through a " web site" which is hosted on a suitable 
digital processing machine such as a personal computer, workstation, etc. Users or "clients" 
use, for example, their personal computers to communicate with a web site via a browser 
program or, simply, "browser." The most commonly used browsers are the Navigator™ from 
Netscape Communications, Inc., and the Internet Explorer™ from Microsoft, Inc. 

It has become increasing simple for companies and individuals to create their own web 
sites. There are a number of commercially available packages which generate the necessary 
HTML code to create "web pages" which can be uploaded to web servers connected to the 
Internet. Connections to the Internet and web server hosts are often provided by a company 
known as an Internet Service Provider (ISP). 

Since web pages are, essentially, programs written in the HTML language, it is possible 
that one or more web pages of a web site contains errors. These errors may only show up 
intermittently since much of the interaction with the web site can be dynamic, i.e. it can change 
from session to session. Therefore, the need has arisen for some method to test web sites for 
errors. 

In Fig. 1, a system 10 for testing a web site includes a TCP/IP protocol network 12, 
such as the Internet, a web server 14 coupled to the Internet 12 by an ISP 16, any number of 
user or client machines such as client machines 18 A, 18B, 18C, etc. coupled to the Internet 12 
by ISP's 20A, 20B, 20C, etc., and a testing computer 22 coupled to the Internet 12 by an ISP 
24. 

In the prior art, software running on the testing computer 22 connects with a web site 
26 hosted by the web server 14 through the Internet 12 and attempts to download web pages. 
Upon a failure to download a web page, the testing computer 22 running this prior art software 
detects an error. 
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It should be noted that a depiction of Fig. 1 is logical in nature, and may be 
implemented in a variety of fashions. For example, the testing computer 22 and the web server 
14 can be the same machine. As another example, any of the client machines 18 A, 18B, 18C, 
etc., or the testing computer 22, or the web server 14 can be connected into the Internet 12 in 
5 other fashions, such as into the "backbone" of the Internet. Further the Internet is only one 

example of a network 12 implementing a TCP/IP protocol. Other examples of TCP/IP protocol 
networks include intranets and extranets, as will be appreciated by those skilled in the art. 

The testing computers 22 of the prior art include testing software which simulate 
browser software to the extent that they can download web pages. The successful downloading 

10 of a web page in the prior art was usually considered sufficient to determine that that web page 
was error free. In some instances, prior art testing computers 22 may examine or "parse" the 
HTML of the downloaded web page to make further determination whether there is an error in 
the downloaded web page. An example of prior art testing software includes the WhatsUp™ 
software of IpSwitch, Inc. of Lexington, Massachusetts ( http://www.ipswitch.com y This 

15 software is capable of testing only a single web page. 

Unfortunately, the simple downloading of web pages with, perhaps, a cursory 
examination of the HTML is often insufficient to determine all the errors that a user might 
encounter when actually interacting with those web pages. This is due, in part, to the complex 
interactivity permitted under the HTML standards, and is due, in part, to the fact that many 
20 interactions with web pages are " dynamic" in that they may change from session to session. It 
would therefore be desirable to have a method for testing a web site which can test multiple 
features of web pages, and which can handle dynamic interactions with the web site. 
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SUMMARY OF THE INVENTION 

The present invention provides a method, apparatus, and system for testing a web site. 
The invention handles a number of interactive modes with the web site being tested, and 
handles dynamic interactions with the web site.. 

A method for testing a web site in accordance with the present invention formulates a 
test configuration file comprising a series of test inquiries for a web site, initiates an HTTP 
communication to form a connection with the web site, and repetitively communicates with the 
web site. More particularly, the method repetitively communicates with the web site by 
receiving HTML from the web site, analyzing HTML for errors and storing the results in the 
database, and then formulating a new HTTP communication to the web site based upon the 
received HTML and the test configuration file. 

The operation of formulating a test configuration file preferably includes sending 
HTML comprising a blank testing form to a web browser, receiving HTTP from the web 
browser as a submission from the testing form and developing the test configuration file from 
the HTTP received from the web browser. In this fashion, a standard web browser can be used 
as the interface between the test operator and the testing software. Preferably, the web browser 
can also be used to edit test configuration filed that has already been developed. 

An apparatus for testing a web site includes a computer having memory and a 
processor, and a monitor object resigning at least partially in the memory and executed by the 
processor. The monitor object includes an initiator to establish an HTTP communication 
between the monitor object and a web site and a repetitive communicator which repeatedly 
receives HTML from the web server, analyses the HTML for errors and stores the results in a 
database, and formulates a new HTTP communication based on the received HTML. 
Preferably, the apparatus also includes a scheduler residing at least partially in the memory and 
executed by the processor which is operative to invoke the monitor object, determine whether 
the monitor object is scheduled to be run, and run the monitor object as scheduled to initiate 
the HTTP communication to form a connection with the web site by repetitively 
communicating with the web site. 

A system for testing a web site includes a TCP/IP protocol network, a web server 
connected to the TCP/IP protocol network and hosting a web site, and a testing computer 
having memory and a processor that is connected to the TCP/IP protocol network. The testing 
computer is operative to formulate a test configuration file stored in the memory including a 
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series of test inquiries for a web site to be tested, to initiate an HTTP communication to form a 
connection with the web site and to repetitively communicate with the web site by receiving 
HTML from the web site, analyzing the HTML for errors, and storing the results in a database, 
and formulating a new HTTP communication based upon the received HTML and test 
5 configuration file. 

An advantage of the present invention is that a web site can be thoroughly tested in a 
variety of interactive modes. Also, the present invention allows for the testing of changeable 
or "dynamic" features of the web site. In consequence, the present invention facilitates the 
thorough testing of web sites for errors and generates reports which aids in the correction of the 
10 detected errors. Other advantages include the capability of immediately providing a 
notification of any problems, and the reporting of performance and service levels. 

These and other advantages of the present invention will become apparent to those 
skilled in the art upon a reading of the following descriptions of the invention and a study of 
the several figures of the drawing. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



Figure 1 is an illustration of a system including the Internet, a number of client 
machines, a web server, and a testing computer; 

5 Figure 2 is a pictorial representation of a testing computer 22' of the present invention; 

Figure 2A is a pictorial representation of testing software implementing the present 
invention, as well as standard web browser software; 

Figure 2B is a flow-diagram illustrating the overall operation of the present invention; 

Figures 3A-3E illustrate a series of HTML web pages that will be used as an example 
1 0 when explaining the present invention; 

Figures. 4A-4C illustrate a blank form used to develop the testing configuration file of 
the present invention; 

Figure 5 is a illustration which helps an explain a HTML " form" ; 

Figure 6 is an exemplary test configuration developed by the process of the present 
15 invention from the web pages of Figs. 3A-3E; 

Figure 7 is a flow-diagram illustrating the "ANALYZE CONFIGURATION FILE 
ACTIVATION SCHEDULE" operation of Fig. 2B; 

Figure 8 is a flow-diagram of the "SEND HTTP TO WEB SITE AND RECEIVE 
HTTP/HTML" operation of Fig. 2B; 

20 Figure 8 A is a flow-diagram detailing " FIND ALL FIELDS ON FORM WITH 

SUBMIT BUTTON" operation of Fig. 8; 

Figure 8B is a flow-diagram illustrating the "TAKE SUPPLIED POST DATA AND 
OVERWRITE VALUES" operation of Fig. 8; and 

Figure 9 is a flow-diagram illustrating the "ANALYZE AND STORE RESULTS IN 
25 LOG FILE" operation of Fig. 2B. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Fig. 1 illustrates a system for testing a web site, wherein, a testing computer 22 
implements a testing process. The differences in the system of the prior art and the system of 
the present invention is the software running on the testing computer 22, or elsewhere in the 
5 system. 

In Fig. 2 a computer apparatus 22' implements a process for testing a web site in 
accordance with the present invention. More particularly, an apparatus 22' of the present 
invention includes a computer 28, a keyboard 30, a video monitor 32, and preferably a mouse 
34 or some other form of pointing device. As will be appreciated by those skilled in the art, 
10 the computer 28 includes a microprocessor 36 and computer readable memory 38 which 

support computer implemented processes. Displayed on the screen 40 of the monitor 32 is a 
web browser window 42 displaying a web page 44 of the present invention. The computer 28 
and the peripherals 30, 34, and 40 comprise standard personal computer and workstation 
equipment, available from a variety of sources 

15 Fig. 2 A illustrates the relationship of tester software 46 of the present invention to web 

browser software 48 and the Internet 12. More particularly, the tester 46 communicates 
directly with the Internet 12 through ISP 24. That is, the tester 46 can pass HTTP to the 
Internet 12 and receive HTTP/HTML from the Internet 12 without the need for an intermediary 
of a web browser. The tester 46 communicates independently with the web browser 48 by 

20 sending HTTP to the web browser 48 and by receiving HTTP/HTML from the web browser 
48. 

As suggested in Fig. 2A, the tester 46 and the web browser 48 can be implemented on 
the same computer apparatus ("machine") or on separate computer apparatus. The case where 
the tester and the web browser have been implemented on the same computer apparatus 22', 

25 they both can operate under the same operating system, i.e. OSl=OS2. However, in the 

instance where the tester 46 and the web browser 48 are implemented on different computer 
apparatus, there is no reason why the two can't be supported on different operating systems, 
i.e. OS1 might be different from OS2. For example, the tester 48 may be implemented under a 
personal computer operating system such as under Windows 95, while the web browser 48 

30 might be implemented on another computer under a workstation operating system such as 
UNIX. 

In Fig. 2B, a flow-diagram illustrates various operations of the tester 46. At a main 
menu 50, it is determined whether the user wants to run the web site tester or to analyze results 
of previous web site tests. If it is determined that the user wishes to analyze results, a "logging 

6 
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file" or " log file" is analyzed and results are displayed in an operation 52. Statistical methods 
for analyzing data, and tabular and graphical methods for displaying data are well known to 
those skilled in the art and will not be described here. If, on the other hand, it is determined 
from the main menu 50 that the web site tester is to be run, an operation 52 analyzes a test 
5 configuration file, as well as an activation schedule. The operation 52 has, as an input, a real- 

time clock 54 which can provide a real-time date 56 and real-time hours, minutes, and seconds 
58. Often, a real time clock 54 provides one long number that represents elapsed time from a 
given date and time, and which can then be algorithmically converted into date, hours, minutes 
and seconds. 

10 If operation 52 detects that a new test configuration file is being requested via a web 

browser 42, a "blank form" is sent in the form of HTTP/HTML to the browser. After the 
blank form has been filled in by a user of the browser, the process receives the information 
from the browser in an operation 62. This is returned in a form of HTTP, as will be 
appreciated by those skilled in the art. Then, operation 64 is used to create a new test 

15 configuration file, and process control is returned to operation 52. 

If, on the other hand, operation 52 determines that the user wishes to edit a test 
configuration file, a "Fig. Form" is sent via HTTP/HTML to the browser in an operation 66. 
The edit information is received from the browser in operation 68 in the form of HTTP. An 
operation 70 then creates the edited test configuration file, and process control is returned to 
20 operation 52. 

When operation 52 determines that it is time to execute the configuration file by 
analyzing the activation schedule and by comparing the activation schedule to information 
received from the real-time clock 54, process control is turned over to operation 72 to 
determine whether the execution of the configuration file is completed. If so, process control 
25 returns to operation 52. If not, then operation 74 sends HTTP to the web site and receives, in 
turn, HTTP/HTML from the web site that is being tested. The HTTP/HTML is analyzed and 
the results are stored in a log file. In addition, the analysis of operation 76 determines the 
nature of the next HTTP transmission to the web site in operation 74. This analysis will be 
described in greater detail below. 

30 In Figs. 3A-3E, a number of exemplary web pages are presented to describe the process 

of the present invention. It should be noted this is just one example of a virtually unlimited 
number of web pages and web page combinations which can be tested by the process of the 
present invention. 
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In Fig. 3 A an illustrated web page 78 is the "home page" of Freshwater Software, Inc. 
Among other features, it includes a series of buttons 80 which form "links" to other web 
pages. In particular, a button 82 makes a link to a " search" web page. 

In Fig. 3B, the search web page 84 that was accessed by the button 82 of the home web 
page 78 includes a number of features including a data entry field 86 and a submit button 88. 
As seen in this example, the data entry field 86 includes the string " John" , such that instances 
of the word "John" on the Freshwater Software web site will be found after the submit button 
88 is activated. As is well known to users of web browsers, buttons such as buttons 82 and 88 
are activated with a pointer device such as the mouse 34, or by pressing the "ENTER" key on 
a keyboard 30. 

Fig. 3C shows a results web page 90 listing all of the instances including the string 
"John" that is on the Freshwater site. 

Fig. 3D illustrates a web page 92 for another company, Macromedia. A portion 94 of 
the web page 92 is a separate web page 94 as illustrated in Fig. 3E. This is an example of 
" framing" wherein a web page is embedded within another web page. Such "nesting" or 
"embedding" can occur to multiple levels, i.e. frames within frames within frames. 

Figs. 4 A, 4B, 4C illustrate the web page 44 of Fig. 2 in greater detail. More 
particularly, these are the web pages used to create a "monitor object" which will be used to 
test and gather data concerning the operation of a web site under test. It should be noted that 
multiple monitors monitoring multiple web sites or monitoring a single web site in multiple 
fashions can be operating simultaneously. This is a well-known function of an object oriented 
programming and of a multi-tasking computer system. However, the following description 
will be in the context of creating a specific monitor an object which will test the functionality 
of the pages of Figs. 3A-3E. 

As noted in Fig. 4A, the "Add URL Transaction Monitor" refers to a number of steps. 
This particular web page 96 is created by activating the "SiteScope" button 96 of the button 
bar 98. Another button 100 labeled "Reports" can be used to generate test result reports. 
Therefore, it will be appreciated that the process 46 of Fig. 2B can utilize a web browser 
window 42 for user interface purposes. 

Under stepl type, a pull down menu 102 is provided which has the entry of URL. This 
is because the stepl reference 104 must always be a URL to act as a starting point for the 
process. The URL can be the URL of a web site home page, or of any other web page. It is 
merely a starting point for the test. The step2 type pull down window 106 is a " link" to a 
button labeled "Search" as in a step2 reference 108. Step3 type is selected to be "Form" in 
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pull down menu 110, while the entry field 1 12 of step3 reference is left blank. Step4 type in 
pull down window 1 14 is "URL" , while the URL in field 1 16 is input as 

" http://www.macromedia.com ." An update box 1 18 is set at every 10 minutes an optional title 
that would appear in the monitor table from the field 120 is left blank. A button 122 is 
activated if the monitor is to be created from this data. 

In Fig. 4B, the web page 96 further includes a "disable" box 124 to temporarily disable 
the monitor sampling and alerting. Next, a stepl POST data field 126 has, as entries, "name = 
abc" and " address = def ' . The data in the POST data field 126 is used to fill in field 
parameters. A stepl match content field 128 includes the string "Thank you for entering your 
name." A stepl "error if match" field 130 includes the string "invalid entry." A stepl 
authorization user name 132 includes a user name Paul, and stepl password field 134 including 
a password " secret." Step2 POST data and step3 POST data can likewise be entered. 

In Fig. 4C, the end of the step3 POST data and the step4 POST data can be seen on the 
remainder of page 96. Below the words "Verify Error" a different portion of the web page 96 
is presented which is generic to other parts of the software of the present invention. More 
particularly, pull down menu 136 permits the update period of minutes, hours, days, etc. to be 
selected while entry filed 138 indicates the number of seconds, minutes, hours, etc. The update 
indicates the amount of time between checks whenever the status of the monitor indicates a 
problem. 

A pull down menu 140 indicates a schedule for the monitor to be enabled. In this 
instance, it is selected to every day, all day. Alternatively, it could be scheduled for Monday 
through Friday, evenings only, etc. Custom schedules can be created by hitting the " edit 
schedule" button 142. 

Fields 144 and 146 are optional fields which allows a user to enter monitor and report 
descriptions, respectively. A field 148 permits a time out period in seconds, to wait for the 
entire sequence to complete. That is, if a monitor session takes more than the time out period, 
an error or warning will be indicated. 

The present invention also permits the use of a proxy server. The fields associated with 
an optional proxy server are shown at 150. In the field 150A, the HTTP proxy is entered. In 
field 150B, the proxy server user name is entered. In field 150C, the proxy server password is 
used. 

A pull down menu 152 is used for the list order for the monitors. As noted previously, 
any number of monitor objects can be created to test multiple web sites or to test the same web 
site in multiple ways. The "list order" indicates where on a list of monitor objects the current 

9 



WO 00/22534 PCTAJS99/23158 - 

monitor object is to be added. In this instance, the list order is " last" . Other list orders include 
"first", "middle", etc. 

The web page 96 also includes an "Error" pull down menu 154 and a "Warning" pull 
down menu 156. In this instance, an error is set if the status is not equal to 200, which is a 
5 default, and a warning will occur if status is equal to -994, which is also a default. A status 

200 means " good" and is associated with the status field of an HTTP request. The -994 
default on the warning is an arbitrary internal coding indicating a software problem. For 
example, if the software takes more than 10 seconds to respond, a status -994 may be 
provided. 

10 In Fig. 5, a form 158 is displayed to illustrate some of the concepts of the present 

invention. The form includes a first label 160 "name:" and a second label 162 called 
"address:" . Associated with the labels 160 and 162 are entry fields 164 and 166, respectively. 
Also associated with the form is a " submit" button 168. The form 158 is as it may appear 
within a browser window. The HTML which creates the form 158 in the browser window is 

15 shown generally at 170. The use of HTML 170 to create a form 158 in a browser window is 

well known to those skilled in the art. 

Fig. 6 illustrates a test configuration file 172 produced by filling out the web page 96 
and hitting the "Add" monitor button 122. The test configuration file includes a number of 
labels or "tags" followed by an equal sign and either a parameter or a blank field. Where the 
20 field is blank, the tag is ignored and default values are used, if any. 

As noted, the monitor description at 174 is an example of a five step transaction. Other 
tags such as frequency, time out, error frequency, etc. are filed in, while a number of tags are 
left blank. For example, since a proxy server is not being used, the tags for the proxy server 
are all left blank. The tags and parameters for step 1 are shown at 176. The "reference type 1" 

25 tag is associated with the parameter "URL" . The tag reference 1 is associated with parameter 
http ://www. freshtech. com . Steps 2, 3, 4, and 5 are found at 178, 180, 182, and 184, 
respectively. It should be noted that the step2 type is "blank" , the step3 type is " form" , the 
step4 type is "URL" and the steps type is " frame" . Therefore, this example of a test 
configuration file 172 illustrates four of the main types of features which can be verified and 

30 tested by the process of the present invention. 

In Fig. 7, a flow diagram of the operation 52 in Fig. 2B is shown in greater detail. The 
process 52 begins at 186, and in operation 188, it is determined whether a new or edited 
configuration file has been created as set forth above. If so, a "monitor object" is created from 
the configuration file for one time execution in an operation 190. The creation and use of 
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software objects are well known to those skilled in the art. Then, in an operation 192, the 
monitor object is " invoked" . By invoked it is meant to end that the monitor object is activated 
for use. In an operation 194, it is determined whether the monitor object is scheduled to run 
with regards to repeat time. If it is not, process control is returned to operationl88. If it is, it is 
5 determined in operation 196 whether the monitor object is scheduled to run by date and time. 

If not, process control is again returned to operation 188. If the monitor object is scheduled to 
run with regards to both repeat time and by date and by time, then the monitor is "run" in an 
operation 198. By "run" it is meant that the monitor object is caused to perform the process of 
the present invention to test a web site. 

10 In Fig. 8, a flow diagram illustrates the process 74 of Fig. 2B in greater detail. The 

process 74 begins at 200, and in an operation 202, the "next step" and cookie is retrieved. 
The next step is the next test step as described above. The "cookie" is a data file received 
from the web site being tested that includes information concerning user preferences, user 
history, etc. An operation 204 determines whether the next step is a null and if so, the process 

15 is completed at 206. If there is a next step, operation208 determines the step type, as described 

below. 

If operation 208 determines that the next step type is "URL" a step 210 sends an HTTP 
request for the URL and the cookie associated with that URL. Process control is then turned 
over to an operation 211 which takes measures based on the HTTP request and response, 
20 analyzes received HTML for expected content and errors using methods such as matching 

against string valves, regular expressions, and calculated valves and stores them in a database. 
Error analysis and matching methods are well known to those skilled in the art. Process 
control then returns to operation 202. 

If operation 208 determines that the step type is a "link", an operation 212 searches the 
25 current HTML for a " link" tag having the specified content. In operation214 determines 

whether the appropriate " link" has been found and, if not, an error message 216 is generated 
the process aborts at 218. If the link is found by the operation 214, an operation 220 sends an 
HTTP request for the URL and the cookie and process control reverts to operation 211. 

If operation208 determines that the step type is " form" , an operation 222 searches the 
30 current HTML for a " submit" button with the specified content. An operation 224 determines 

whether the appropriate " submit" button has been found, and if not, operation 228 determines 
that there is an error and the process 76 aborts at 229. If the appropriate submit button is found 
by operation 224, an operation 230 finds all fields on the form with the submit button and 
determines or calculates the default values for this field. An operation 232 then takes the 
35 supplied post data and overlays the default values such that all appropriate fields have been 
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filled. An operation 234 then sends an HTTP request "post" plus the cookie and process 
control returns to 21 1. 



If operation 208 determines that the step type " frame" an operation 236 searches the 
current HTML for a " frame" tag. An operation 238 determines whether the appropriate frame 
5 tag has been found. If not, an operation 240 indicates an error and the process 76 aborts at 241 . 
If the appropriate frame tag has been found by operation 238, an operation 242 sends an HTTP 
request for the URL and the cookie. Process control then returns to operation 211. 

In Fig. 8A, the operation 230 of Fig. 8 is described in greater detail. The process 230 
begins at 243 and, in a operation 244, all form input elements are determined. If a form input 

10 element is not recognized, then the process is complete at 260. If operation 244 finds a radio 
button input element, operation 248 picks the first radio button for the value. If the operation 
244 finds a check-box for the input element, an operation250 determines whether the box is 
checked. If it is, an operation 252 sets the value, and if it is not an operation 254 indicates that 
there is no value. If an operation 244 finds a text input element, an operation 256 sets the 

15 value to the default string. If operation 244 finds pop-up menu, an operation 258 picks the 

default as the value. The process 230 is then complete at 260. 

In Fig. 8B, the process 232 of Fig. 8 is illustrated in greater detail. The process 232 
begins at 262 and, in an operation 264, values from operation 230 (see Fig. 8) are written into 
the name tags. For example, namel is set to an arbitrary or default value 1, name2 is set to an 
20 arbitrary or default value2, etc. Next, in an operation 266, the "post data" entered by the user 
is used to override the appropriate name tags. In this instance, the name tag "name 2" is set to 
the data "Paul" . The final, merged data is illustrated at 268 and the process is completed at 
270. 

In Fig. 9, the process 76 of Fig. 2B is illustrated in greater detail. The process 76 
25 begins at 272, and in an operation 274, it is determined whether there are any aborts that 

occurred within the process 74. If there were, an operation 276 displays and logs a an error 
message. If there were not any aborts, then the process 74 terminated normally in an operation 
278, and the process displays and logs the URL and the size of each web page and the time it 
took to download into a log file. An operation 280 displays and logs the total time for the 
30 download in an operation 280. In an operation 281 it is determined whether there are any 
alerts. If there were, an operation 282 activates a process. The process would commonly 
notify a person using a mechanism such as e-mail or pager or cause a user-specified process to 
start. The process is then complete at 283. 
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While this invention has been described in terms of several preferred embodiments, it is 
contemplated that alternatives, modifications, permutations and equivalents thereof will 
become apparent to those skilled in the art upon a reading of the specification and study of the 
drawings. It is therefore intended that the following appended claims include all such 
5 alternatives, modifications, permutations and equivalents as fall within the true spirit and scope 

of the present invention. 

What is claimed is: 
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1 . A method for testing a web site comprising: 

formulating a test configuration file comprising a series of test inquiries for a web site 
5 to be tested; 

initiating an HTTP communication to form a connection with said web site; and 
repetitively communicating with said web site by: 
receiving HTML from said web site; 

analyzing said HTML for errors and storing results in a database; and 

10 formulating a new HTTP communication based upon said received HTML and 

said test configuration file. 

2. A method for testing a web site as recited in claim 1 wherein said operation of 
formulating a test configuration file comprises: 

1 5 sending HTML comprising a blank testing form to a web browser; 

receiving HTTP from said web browser as a submission from said HTML testing form; 

and 

developing said test configuration file from said HTTP from said web browser. 

20 3. A method for testing a web site as recited in claim 2 wherein said operation of 

formulating a test configuration file further comprises: 

developing a filled testing form from an existing test configuration file; 

sending HTML comprising said filled testing form to a web browser; 

receiving HTTP from said web browser as a submission from said HTML testing form; 

25 and 
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updating said test configuration file from said HTTP from said web browser. 



4. A method for testing a web site as recited in claim 1 wherein said method is 
implemented as a computer implemented process. 

5. A method for testing a web site as recited in claim 4 wherein said computer 
implemented process is capable of direct HTTP and HTML communication with said web site. 

6. A method for testing a web site as recited in claim 5 wherein said direct HTTP 
and HTML communication is over a TCP/IP protocol network. 



7. A method for testing a web site as recited in claim 1 further comprising 
analyzing said database and providing a display of the results of said web site testing. 

8. A method for testing a web site as recited in claim 1 wherein said test 
configuration file provides a plurality of tests selected from the group comprising a URL, a 
link, a form button, and a frame. 

9. A method for testing a web site as recited in claim 1 further comprising 
analyzing said database and sending alerts of the results of said web site testing. 

10. A method for testing a web site as recited in claim 8 wherein said test 
configuration file includes comparison data used to compare HTML received from said web 
server with a predetermined criteria. 

11. A method for testing a web site as recited in claim 1 wherein said test 
configuration file comprises an automatic scheduling for testing said web site. 

15 



WO 00/22534 



PCT/US99/23158 



12. A method for testing a web site as recited in claim 1 wherein said automatic 
scheduling includes scheduling window information, and test repetition information. 

5 13. A method for testing a web site as recited in claim 1 further comprising: 

creating a monitor object from said test configuration file; and 
repetitively testing said web site by 
evoking said monitor object; 

determining whether said monitor object is scheduled to be run; and 

10 running said monitor object when it is scheduled to be run to initiate said HTTP 

communication to form a connection with said web site and by repetitively communicating 
with said web site. 

14. A computer readable media including the program instructions and data for 
1 5 implementing the method of claim 1 . 

15. An apparatus for testing a web site comprising: 
a computer having memory and a processor; 

a monitor object residing at least partially in said memory and executed by said 
20 processor, said monitor object including 

means for initiating an HTTP communication to form a connection with a web site; and 

means for repetitively communicating with said web site by 

receiving HTML from said web server; 

analyzing said HTML for errors and storing results in a database; and 

25 formulating a new HTTP communication based upon said received HTML. 
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16. An apparatus for testing a web site as recited in claim 15 further 

comprising: 

a scheduler operative to 

invoke said monitor object; 

determine whether said monitor object is scheduled to be run; and 

running said monitor object when it is scheduled to be run to initiate said HTTP 
communication to form a connection with said web site and by repetitively 
communicating with said web site. 

17. An apparatus for testing a web site as recited in claim 16 further comprising: 
means for creating said monitor object from a test configuration file. 

18. An apparatus for testing a web site as recited in claim 17 further comprising: 
means for creating said test configuration file by communication with a web browser. 

19. A system for testing a web site comprising: 
a TCP/IP protocol network; 

a web server connected to said TCP/IP protocol network and hosting a web site; 

a testing computer connected to said TCP/IP protocol network, said testing computer 
having memory and a processor, said testing computer being operative to formulate a test 
configuration file stored in said memory comprising a series of test inquiries for a web site to 
be tested, to initiate an HTTP communication to form a connection with said web site, and to 
repetitively communicate with said web site by receiving HTML from said web site; analyzing 
said HTML for errors and storing results in a database; and formulating a new HTTP 
communication based upon said received HTML and said test configuration file. 
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20. A system for testing a web site as recited in claim 19 wherein said testing 
computer includes a monitor object residing at least partially in said memory and executed by 
said processor. 

21 . A system for testing a web site as recited in claim 20 wherein said testing 
computer includes a scheduler operative to invoke said monitor object, determine whether said 
monitor object is scheduled to be run; and running said monitor object when it is scheduled to 
be run to initiate said HTTP communication to form a connection with said web site and by 
repetitively communicating with said web site. 

22. An apparatus for testing a web site comprising: 
computer means including 

means for formulating a test configuration file comprising a series of test 
inquiries for a web site to be tested; 

means for initiating an HTTP communication to form a connection with said 
web site; and 

means for repetitively communicating with said web site by: 
receiving HTML from said web site; 

analyzing said HTML for errors and storing results in a database; and 

formulating a new HTTP communication based upon said received 
HTML and said test configuration file; and 

connecting means for connecting said computer means to a TCP/IP network through 
which said web site can be accessed. 

23. An apparatus for testing a web site as recited in claim 22 wherein said means 
for formulating a test configuration file comprises: 
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means for sending HTML comprising a blank testing form to a web browser; 

means for receiving HTTP from said web browser as a submission from said HTML 
testing form; and 

means for developing said test configuration file from said HTTP from said web 
browser. 

24. An apparatus for testing a web site as recited in claim 23 wherein said means 
for formulating a test configuration file further comprises: 

means for developing a filled testing form from an existing test configuration file; 

means for sending HTML comprising said filled testing form to a web browser; 

means for receiving HTTP from said web browser as a submission from said HTML 
testing form; and 

means for updating said test configuration file from said HTTP from said web browser. 
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freshwater 

Is your business-critical web site up right now? 
How do you know? 

XfyouhadSiteScopeandSit^ 

confident that you would be noUfie ^^^^S. and service availability. Error 
monitor everything from memory and d. * * aceusa^ ge ^ also ^ ^ pts t0 

SiteScope Software SiteSeer Service 

E-conimerce Transaction Testing 

Version 3.0 Available Now! Available! 

. 24 hour monitoring of web pages, forms, ^ ^ ^ monitoring 2 4 hours a day 

servers, and more... t „ Support for secure URLs 

. Immediate error notification via e-mail, ^ verification of password protected pages 

pager, or SNMP trap # String matching on both page content and 

• Escalation of notification error messages 
. Automatic error recovery 

• Ability to integrate with enterprise 
solutions 

SiteScopr * ™> tes! 



Fresh News... 

.PCToday raves about SiteScope in the work place in its February issue. MU*** 

w the world's largest dedicated server web site management 
►DIGEX chooses SiteScope to monitor the world s large 
facilities. EaiLSiery. 

"They've found an important niche from a web server 
adminTsS^erspective!. It's expandab^and customable, 

it's a fantastic product. 
--BradHogan.NewbridgeNetworks.Mar^^ 
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Search Us 

To search the documents on the Freshwater Software™ Web site, enter the words you want to search 
for below. ^ 

^ 

Search For r ' 

Find ' r b^uments;«^ 



By default, only documents containing all the words are found. To find documents containing any of 
the words/separate them with "OR". For example, 'mail OR support 1 to find any documents 
containing either of these words. 
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TO day SiteScope evaluation license 
(10 days remaining) 
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Add URL Transaction Monitor ,a ° 
A™ 

Step 1 Type the type of item being referred to in the reference (the next field) - this is used to determine with parts 
of the HTML will be scanned for text matches. joH^ 



Step 1 UH?://***'' ^sA^cZ " 



o a | ____ ^ r<ryv / f 

Reference the URL, link, or submit button to be followed at this step (examples: a URL of 
http://demo.freshtech.com, a link of Next, or a button name of Submit) 

„ . TftTlOb 

| L\NVC Cti 

Step 2 Type the ^ of hem being re f erred t0 m the reference (the next field) - this is used to determine with parts 
of the HTML will be scanned for text matches. y /O S 

Step 2 I Serntzctf- .... ' \ 

Reference the URL, link, or submit button to be followed at this step (examples: a URL of 
http://demo.freshtech.com, a link of Next, or a button name of Submit) 



I 



77B 



no 



Step 3 Type mc ^ 0 * f item being referred t0 j n the reference (the next field) - this is used to determine with parts 
of the HTML will be scanned for text matches. 



Step 3 



3- 



Reference the URL, link, or submit button to be followed at this step (examples: a URL of 
http://demo.freshtech.com, a link of Next, or a button name of Submit) 



jURT 



JWIM. ^ ;,„, ■ 

Step 4 Type the type of item being referred to in the reference (the next field) - this is used to determine with parts 
of the HTML will be scanned for text matches. 



Step 4 l JbJ±/LA 



Reference the URL, link, or submit button to be followed at this step (examples: a URL of 
http://demo.freshtech.com, a link of Next, or a button name of Submit) 

Update | 1Q ^[minutes [gy ^ j^O 

every ^j,^ G f time between checks of a monitor 

Title 




title that should appear in the Monitor table (optional) 



Monitor 
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\J3 Disable 

temporarily disable monitor sampling and alerting * 

. 7^ 



Step 1 POST Data 



optional name=value variables, one per line, to send with a POST request for this step 



Step 1 Match j v ^ ^^~-< „ 

Content optional text to match against content of the URL for this step 



Step 1 Error If [ -X^^JU:Jj o^^<^ 



Match 0 p tion aliy generate an error if the content of the URL for this step contains this text 

13^ 



AU User Nar^e optional user name if the URL for this step requires authorization 



Step 



1 Password 



i3 y 



optional password if the URL for this step requires authorization 



Step 2 POST Data 



mi 



Clonal name-value variables, one per line, to send with a POST request for this step 



Step 2 Match [ 



Content opt ional text to match against content of the URL for this step 



Step 2 Error If [ 



Match optionally generate an error if the content of the URL for this step contains this text 



Step 2 r 
Authorization L 



User Name optioTaUs^name if the URL for this step requires authorization 
Step 2 Password Q j|^^f^ requires authorization 



Step 3 POST Data 




pTio^afname-value variables, one per line, to send with a POST request for this step 



Step 3 Match [ 



Content opt ional text to match against content of the-URL for this step 



Step 3 Error If [ 



Match optionally generate an error if the content of the URL for this step contains this text 



Step 3 
Authorization 



User Name optional user name if the URL for this step requires authorization 
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Step 3 Password QptionaI password if ^ URL f or t hi s step requires authorization 



Step 4 POST Data 



optional name=value variables, one per line, to send with a POST request for this step 



Step 4 Match | 

Content opt ional text to match against content of the URL for this step 



Step 4 Error If [ I 

Match optionally generate an error if the content of the URL for this step contains this text 

Step 4 j- 



Authorization 



User Name optional user name if the URL for this step requires authorization 



Step 4 Password L— 



optional password if the URL for this step requires authorization 
Verify Error 

if the monitor detects an error, immediately perform the check again to verify the error. 



Update every (on 



minutes 



errors) the amount of time between checks whenever the status of the monitor is not ok, the Update 

ri 



value from above is used if this^ |eft blank 



[ every day, all day , 
Schedule schedu i e for ^ monitor to be enabled - for example, disable Sunday from 10:00 to 14:00, if 
blank monitor is always enabled 



. blank monitor is always enaoicu . 

) ' ^ " ^ fedit Schedules C*+- * ^ f ^ „ f 



Monitor 



1Y1U1U1.1U i . . ' 

Description additional description of monitor that appears on Monitor Detail page (optional) ^ 



Report Description 



Timeout 



3" 



additional description of monitor that appear! on Reports and in monitor popup info (optional) 

=hvs 



160 



the time out, in seconds, to wait for entire sequence to complete 



HTTP Proxy I 



optional proxy server to use including port (example: proxy.freshtech.com:8080) ( 



Proxy Server User [ 



Name optional user name if the proxy server requires authorization 



Proxy Server 



"V ™ i : — 

Password 0pt i O nal password if the proxy server requires authorization 



List Order 



choose where this monitor appears in the list of motors on the Monitor Detail page 



Error if \s^^^(de!^ 




Warning if jstatus^^j<»etajjgj_ 



Mogi tor 



ElC 



1 
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example .mg \ 

_id=l 

class=URLSequenceMonitor 
^1 ~name=URL Transaction: http://www.freshtech.com 
* v description^ 
\i_monitorDescription=Example transaction of 5 steps 

_f requency^OO 
_t imeout=60 
_errorFrequency=120 

__disabled=f alse \ 
_verif yError=false : | 
_proxy= 

_proxyusername- { 
_proxypassword= 

schedule- 
"^referenceTypel-url 

_ref erencel==http : //www . f reshtech - com 

errorContentl=Not Found ^ ^ ^ 

_usernamel= J L 

_passwordl= 
_contentl- 

_referenceType2=link 
_ref erence2^SEAJRCH • 

errorContent2- 
_username2= 
_password2= 
content2- 

ref erenceType3=f orm 
_reference3=Find Documents 
_postData3=KEYW0RDS=John 
content 3=Of f icer 
errorContent3= 
_username3= 
_password3= 

ref erenceType4=url 
*~reference4=http: //www. macromedia. com/ index. html 

errorContent4= 
user name 4= 
password4- 
_content4- 
| z^__ref erenceType5=f rame 
_ref erence5-mm_nav 
_errorContent5- 
_username5= 
_password5= 
^_content5= 
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